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This  report  describes  the  effects  that  a  controlled  vocabulary  has  on 
the  indexing  and  searching  operations  of  the  document  retrieval  system 
established  by  the  University  of  Dayton  for  the  Air  Force  Materials  Labora¬ 
tory.  The  system  contains  about  30,  000  scientific  and  technical  reports 
covering  all  aspects  of  materials  research  and  is  controlled  by  a  vocabulary 
of  10,  000  terms.  In  general,  the  use  of  a  controlled  vocabulary  has  been 
found  to  be  very  beneficial  to  the  overall  operation  of  the  system.  Also  de¬ 
scribed  are  three  search  strategies  that  are  used  to  effectively  retrieve 
information  in  a  format  that  is  more  useful  to  a  user  than  merely  a  list  of 
document  numbers. 
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I.  INTRODUCTION 


The  Air  Force  Materials  Laboratory  (AFML),  through  its  Materials 
Information  Branch,  sponsors,  supports  or  controls  the  activities  of  seven 
specialized  information  and  data  centers  which  are  located  throughout  the 
country.  These  activities  are  collectively  referred  to  as  the  Air  Force 
Materials  Information  Centers  (AFMIC)  and  have  the  common  goal  of  satis¬ 
fying  materials  information  needs  of  the  scientific  and  technical  community. 
The  Aerospace  Materials  Information  Center  (AMIC)  is  an  organization  within 
the  Air  Force  Materials  Laboratory  that  collects,  interprets,  organizes  and 
disseminates  technical  information  on  all  materials  of  concern  to  the  labora¬ 
tory  in  conjunction  and  coordination  with  the  other  Air  Force  Materials  Infor¬ 
mation  Centers.  The  University  of  Dayton,  under  contract  to  the  Air  Force, 
established  and  has  maintained  a  document  retrieval  system  for  a  collection 
of  approximately  30,000  scientific  and  technical  reports  to  service  the  par¬ 
tial  needs  of  that  center.  The  establishment  and  modification  of  the  system 
are  described  in  detail  in  the  previous  reports  RTD-TDR- 63-4263  (AD 
428423)  and  AFML-TR-65-20  (AD  613301). 

This  report  describes  work  accomplished  from  December  1964  to 
December  1965  and  is  primarily  concerned  with  a  review  of  operating  the 
system  with  modifications  made  the  previous  year.  To  better  understand 
this  review,  the  aforementioned  reports  are  summarized  below. 

The  original  system  that  was  established  by  the  University  was  a 
coordinate  indexing  system  based  on  the  use  of  very  specific  terminology 
and  the  utilization  of  links  and  roles.  The  information  to  be  contained  in 
the  system  was  a  collection  of  approximately  10,  000  scientific  and  technical 
reports  that  dealt  with  all  aspects  of  materials  research  of  interest  to  the 
Air  Force.  There  was  no  predetermined  vocabulary  and  the  indexers  were 
permitted  to  use  whatever  terminology  that  was  needed  to  adequately  de¬ 
scribe  the  documents  they  indexed.  The  first  five  hundred  documents  that 
were  indexed  averaged  over  eighty  link-role-term  combinations  per  report. 

As  the  indexers  gained  experience,  the  average  number  of  entries  was 
gradually  reduced  to  slightly  over  forty. 

An  attempt  to  build  a  thesaurus  of  the  system’s  vocabulary  was  made 
during  the  second  year  of  operation.  At  that  time,  about  6,  000  documents 
had  been  indexed  and  a  thesaurus  of  slightly  over  18,000  terms  was  gener¬ 
ated.  When  the  system  was  updated  in  December  1963,  the  addition  of  4,000 
documents  to  the  system  generated  30,  000  new  terms.  Although  the  system 
had  been  used  to  effectively  retrieve  information  in  answer  to  search  queries, 
the  rapid  growth  of  the  vocabulary  became  of  concern  since  it  was  desirable 
to  maintain  manual  searching  capabilities. 


1 


The  results  of  an  evaluation  of  the  use  of  links  and  roles  in  the  sys¬ 
tem,  and  the  rapid  growth  of  the  vocabulary,  formulated  the  basis  for  modi¬ 
fying  the  system  during  the  fourth  year  of  operation.  Although  the  use  and 
value  of  role  indicators  were  questioned  during  the  period  of  establishing 
the  system,  a  decision  was  made  to  continue  their  use  until  the  system  was 
operable  and  could  be  formally  evaluated.  An  evaluation  was  made  after  the 
system  was  established  and  confirmed  the  opinion  that  the  use  of  roles  was 
more  detrimental  than  helpful  to  the  system.  The  use  of  roles  was  then  dis¬ 
continued  and  that  elimination,  in  addition  to  the  continual  growth  of  the 
vocabulary,  necessitated  modifications  in,  and  the  establishment  of,  vocabu¬ 
lary  controls. 


The  naming  of  materials,  primarily  metallic  alloys  and  organic  com¬ 
pounds,  accounted  for  the  major  portion  of  the  rapid  and  apparently  unending 
growth  in  the  vocabulary.  Since  the  documents  that  were  indexed  into  the 
system  dealt  with  the  research  and  development  of  materials,  the  generation 
of  new  terms  was  anticipated  but  the  quantity  far  exceeded  the  expectations. 

The  approach  taken  to  establish  a  vocabulary  control  was  to  divide  the  vocabu¬ 
lary  into  classes  of  materials  for  analyses.  The  purpose  of  each  analysis 
was  to  determine  the  possibility  of  generalizing  the  naming  of  materials  with¬ 
out  losing  an  undue  amount  of  specificity.  Through  these  generalizations, 
controls  were  established  for  the  naming  of  materials  and  the  system's  vo¬ 
cabulary  was  reduced  to  approximately  10,000  terms.  Although  6,000  new 
documents  have  been  added  to  the  system  during  the  past  year,  the  vocabulary 
has  remained  fairly  constant. 

The  remainder  of  this  report  deals  with  the  effects  of  the  vocabulary 
controls  on  the  input- output  operations  of  the  system.  A  listing  of  the  searches 
performed  by  the  University  during  the  past  year  is  appended  to  this  report. 


II.  INPUT  OPERATIONS 

The  elimination  of  role  indicators  in  the  indexing  process  had  the 
immediate  effect  of  reducing  the  average  number  of  index  entries  per  report 
from  slightly  ever  40  to  about  27.  Since  the  evaluation  of  the  use  of  roles 
showed  that  they  harmed  rather  than  helped  the  system,  both  the  efficiency 
and  effectiveness  of  the  system  were  improved  through  their  elimination. 

The  use  of  a  controlled  vocabulary  during  the  past  year,  particularly  in  the 
naming  of  materials,  has  further  reduced  the  average  number  of  index  en¬ 
tries  per  document  to  12  or  13.  Several  of  the  first  documents  indexed  at 
the  University  were  reindexed  to  see  the  effect  that  the  vocabulary  controls 
and  the  elimination  of  role  indicators  had  on  indexing.  Even  though  several 
of  those  documents  had  originally  been  indexed  with  more  than  200  entries 
each,  they  were  reindexed  with  less  than  20  entries  per  document.  In  all 
cases,  about  half  of  the  reduction  was  caused  by  eliminating  the  role  indicators 
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while  the  remainder  of  the  reduction  was  brought  about  by  the  use  of  generic 
groups  in  the  naming  of  materials  and  the  reduction  in  the  use  of  links. 

Under  the  system  of  controlled  vocabulary,  indexing  speed  has  been 
greatly  facilitated.  It  is  much  easier  for  the  indexer  to  become  familiar 
■with  the  terminology  in  a  system  where  the  vocabulary  remains  more  or  less 
static.  It  should  be  noted  here  that  the  University  is  not  operating  with  a 
closed  vocabulary.  It  is  still  possible,  and  very  desirable,  to  add,  change 
or  delete  terms  as  needed.  The  primary  effect  of  the  vocabulary  changes 
made  was  to  provide  a  more  generalization  of  terminology  while  still  main¬ 
taining  a  fair  degree  of  specificity.  This  generalization  has  tended  to  re¬ 
quire  the  indexer  to  use  more  discretion  in  the  choice  of  index  terms  and  to 
disregard  the  minor  details  of  each  report  indexed.  Since  the  size  of  this 
system  has  grown  from  6,000  to  30,000  documents,  the  minor  details  of  each 
report  are  no  longer  required  to  answer  questions.  They  would,  in  fact,  be 
overlooked  when  retrieved  with  more  pertinent  documents  since  abstracts 
of  retrieved  documents  are  the  primary  means  of  screening  search  results 
and  abstracts  generally  cover  only  the  more  important  parts  of  the  reports. 

It  is  difficult  to  give  a  quantitative  evaluation  of  the  merits  of  the  con¬ 
trolled  vocabulary  at  this  time  since  any  evaluation  would  be  highly  subjective. 
All  of  the  University  staff  members  who  are  indexing  documents  at  the  pre¬ 
sent  time  were  also  the  persons  who  established  the  vocabulary  controls  and 
are  the  individuals  who  set  up  and  screen  search  queries.  This  situation  is, 
of  course,  ideal  and  provides  for  a  very  workable  system.  Each  individual 
maintains  control  over  the  vocabulary  in  his  field  of  interest  and  any  changes 
that  are  needed  are  somewhat  dictated  by  the  vocabulary  needed  to  index  the 
documents  in  his  area  and  the  type  of  terms  needed  to  formulate  search 
questions. 

The  present  vocabulary  now  contains  terms  that  are  capable  of  accom¬ 
modating  nearly  all  indexing  situations.  Because  of  the  work  that  has  been 
invested  in  deriving  this  useful  vocabulary,  it  is  respected  by  the  indexers 
and  a  genuine  effort  is  made  to  logically  express  indexable  material  with  ex¬ 
isting  terminology.  New  terms  are  added  only  after  careful  thought  by  the 
staff  and  only  when  they  are  needed  and  cannot  conveniently  be  accommodated 
with  the  existing  vocabulary.  Instead  of  creating  new  terms  for  infrequent 
occurrences,  scope  notes  are  used  to  provide  additional  or  more  specific 
information  for  the  screening  of  search  results.  The  scope  notes  may  ap¬ 
pear  either  on  the  indexing  record  or  in  a  3"x5M  card  file  that  each  indexer 
maintains  of  terms  that  do  not  appear  in  the  vocabulary.  Each  card  contains 
enough  information  to  define  the  new  term  and  to  indicate  the  term  or  com¬ 
bination  of  terms  used  to  express  the  new  term  in  the  existing  vocabulary. 

As  the  frequency  of  use  of  a  new  term  increases,  it  is  reviewed  for  possible 
inclusion  in  the  system.  This  procedure  prevents  the  use  of  unnecessary 
terms. 
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information  on  some  general  properties  of  a  specific  material  is  often  re¬ 
quested.  Even  though  specific  materials  are  scope  noted  on  the  index  records, 
the  number  of  records  to  be  screened  is  often  quite  large.  The  handling  of 
metallurgical  terminology  will  require  further  analysis  and  modification. 

The  fact  that  the  majority  of  questions  asked  of  this  system  have  dealt 
with  properties  of  materials  led  to  the  development  of  three  search  strategies. 
Depending  on  the  information  sought,  any  one  of  these  strategies  can  effec¬ 
tively  be  used  to  set  up  the  search  question^  screen  the  search  results,  and 
provide  the  user  with  a  categorized  listing  of  the  properties  and/or  materials. 
Although  terms  have  been  coined  to  differentiate  the  strategies,  they  will  be 
referred  to  as  strategies  1,-  2  and  3  in  this  report.  Although  the  various 
strategies  can  be  generalized,  a  clear  description  of  them  cannot  be  given 
without  the  use  of  examples.  The  cited  examples  can  be  interpolated  to  meet 
the  requirements  of  similar  problem  situations. 

Search  strategy  1  was  used  to  answer  an  information  request  on  fabri¬ 
cation  techniques  for  high  temperature  resin  sandwich  structures  with  em¬ 
phasis  being  placed  on  the  use  of  PBI  or  polyimide  resins  and  adhesives. 

The  search  strategy  used  involved  the  grouping  of  six  Boolean  expressions: 


Group  1 

AND 

Fabrication 

OR 

Manufacturing  Technology 

Group  2 

AND 

Sandwich  Structure 

OR 

Polyimide  s 

OR 

Nitrogen  Heterocycle  Polymers 

OR 

Heat  Resistant  Polymers 

OR 

Adhesives 

Group  3 

AND 

Sandwich  Structure 

OR 

Polyimide  s 

OR 

Nitrogen  Heterocycle  Polymers 

OR 

Heat  Resistant  Polymers 

Group  4 

AND 

Sandwich  Structure 

OR 

Polyimides 

OR 

Nitrogen  Heterocycle  Polymers 

Group  5 

AND 

Sandwich  Structure 

OR 

Polimides 

Group  6 

AND 

Sandwich  Structure 

No  attempt  will  be  made  here  to  explain  the  choice  of  terms  used  in  the  search 
since  it  is  the  grouping  of  the  terms  that  is  important  to  the  strategy  used. 

The  cutoff  point  for  this  search  was  chosen  at  the  end  of  the  second  group. 

This  meant  that  at  least  one  term  from  the  first  group  and  one  term  from 
the  second  group  must  have  appeared  in  the  indexing  of  a  document  to  be  ac¬ 
cepted  as  a  document  that  satisfied  the  requirements  of  the  search.  The 
computer  program  used  by  the  University  prints  out  search  results  in  re¬ 
verse  order;  that  is,  it  first  prints  out  the  numbers  of  documents  that  contain 


5 


all  the  words  in  the  search  {since  they  should  be  the  ones  most  pertinent  to 
the  question)  and  gradually  decreases  one  group  at  a  time  until  tne  cutoff 
point  is  reached.  In  analyzing  the  results  of  the  above  search,  any  document 
listed  as  containing  terms  from  all  six  groups  meant  that  at  least  one  of  the 
terms  in  the  first  group  and  the  term  SANDWICH  STRUCTURE  were  used  in 
the  indexing  of  that  document.  This  is  true  because  in  the  search  strategy 
the  term  SANDWICH  STRUCTURE  was  repeated  each  time  from  the  second 
through  the  sixth  group.  The  second  listing  on  the  search  tabulation  showed 
the  documents  that  contained  one  of  the  terms  from  the  first  group  and  at 
least  the  term  POLYIMIDES  but  not  SANDWICH  STRUCTURE.  This  can  be 
analyzed  from  the  fact  that  if  SANDWICH  STRUCTURE  appeared  in  the  index¬ 
ing  of  a  document,  that  document  would  have  been  carried  through  all  six 
groups.  This  same  elimination  process  holds  true  right  on  down  to  the  cut¬ 
off  point.  Any  documents  listed  in  this  last  group  meant  that  either  of  the 
terms  FABRICATION  or  MANUFACTURING  TECHNOLOGY  and  the  term 


ADHESIVES  were  used  in  the  indexing  of  those  documents  but  not  the  terms 
SANDWICH  STRUCTURE,  POLYIMIDES,  NITROGEN  HETEROCYCLE  POLY¬ 
MERS  or  HEAT  RESISTANT  POLYMERS.  If  any  of  those  latter  terms  had 
been  used  in  conjunction  with  one  of  the  terms  from  the  first  group,  the  docu¬ 
ment  would  have  appeared  earlier  in  the  tabulation  of  the  search  results.  By 
using  this  strategy  the  searcher  was  able  to  furnish  the  user  with  a  listing  of 
documents  that  pertained  to  the  fabrication  or  manufacturing  technology  of 
sandwich  structures,  the  fabrication  or  manufacturing  technology  of  polimides 
often  used  in  sandwich  structure,  the  fabrication  or  manufacturing  technology 
of  nitrogen  heterocycle  polymers,  the  fabrication  or  manufacturing  techno¬ 
logy  of  heat  resistant  polymers,  and  finally  the  fabrication  or  manufacturing 
technology  of  adhesives. 


Search  strategy  2  gives  the  same  results  as  strategy  1  but  can  often 
be  used  to  effectively  shorten  the  search  query.  However,  since  this  strategy 
involves  use  of  the  Boolean  expression  ’’NOT”,  extreme  care  must  be  taken 
so  as  not  to  eliminate  pertinent  information.  The  example  used  to  explain 
this  strategy  is  based  on  a  request  for  information  on  ceramic  reinforced 
composites.  The  search  was  set  up  as  follows: 


Group  1 

AND 

Reinforcement 

OR 

Whiskers 

OR 

Filaments 

OR 

Fibers 

Group  2 

NOT 

Polymers 

Group  3 

AND 

Composites 

Group  4 

NOT 

Glasses 

Group  5 

NOT 

Nitrides 

Group  6 

NOT 

Carbides 

Group  7 

NOT 

Graphites 

Group  8 

NOT 

Borides 

Group  9 

NOT 

Single  Oxides 
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Group  10  NOT  Boron 

Group  11  NOT  Mixed  Oxides 

Again,  the  choice  of  terminology  is  not  important  to  understanding  the  stra¬ 
tegy  used.  Since  composites  was  the  important  concept  of  this  request,  the 
cutoff  was  placed  after  group  3  and,  as  in  strategy  1,  the  results  are  tabu¬ 
lated  in  reverse  order.  Therefore  the  first  list  of  documents  would  contain 
the  term  COMPOSITE,  one  of  the  terms  from  the  first  group,  but  none  of 
the  terms  from  group  2  or  from  groups  4  through  11.  The  second  listing  of 
documents  would  be  concerned  with  mixed  oxide  reinforced  composites,  the 
third  grouping  with  boron  reinforced  composites,  etc.  This  strategy  is  not 
without  its  faults  since  the  listing  containing,  for  instance,  all  boron  rein¬ 
forced  composites  is  not  necessarily  complete.  If  a  document  had  been  in¬ 
dexed  with  the  term 8  GLASSES  and  BORON  along  with  some  type  of  reinforced 
composite,  the  term  GLASSES  would  prevent  it  from  being  listed  with  other 
documents  pertaining  to  boron  reinforced  composites.  This  strategy  does, 
however,  break  the  retrieval  into  categories  that  may  be  of  value  to  the  user. 
This  is  particularly  true  if  some  type  of  weighted  value  can  be  assigned  to 
the  MNOTu  groups  with  the  more  weighted  value  being  listed  first  and  the  re¬ 
mainder  in  descending  value  of  importance. 

Strategy  3  involves  the  running  of  multiple  searches  to  answer  a  single 
question.  This  strategy  is  most  helpful  when  searching  for  various  proper¬ 
ties  of  several  materials.  The  example  used  in  this  case  is  based  on  a  re¬ 
quest  for  information  on  the  thermodynamic  or  physical  properties  of  alumi¬ 
num,  copper,  tin  and  iron  halide 8.  The  requestor  also  wanted  information 
on  the  synthesis,  kinetics  and  decomposition  of  the  metal  halides  as  well  as 
information  on  any  other  properties  of  the  halides  that  may  be  in  the  system. 
In  setting  up  the  search  strategy  for  this  question  (which  will  not  be  repeated 
here  because  of  its  length),  the  halides  reported  in  the  system  at  that  time 
were  aluminum  chloride,  aluminum  bromide,  aluminum  iodide,  aluminum 
fluoride,  copper  chloride,  copper  bromide,  copper  iodide,  iron  chloride, 
iron  bromide,  iron  fluoride  and  tin  chloride.  The  properties  and  other  terms 
used  to  correlate  with  the  halides  were  physical  properties,  thermodynamic 
properties,  thermodynamics,  synthesis,  decomposition,  dissociation,  ki¬ 
netics,  chemical  reduction,  oxidation,  vaporization  and  sublimation.  By  use 
of  strategy  1,  the  searcher  was  able  to  correlate  the  individual  halides  with 
the  general  group  of  properties  and  separate  out  each  metal  halide.  Thus, 
in  the  search  result  tabulation,  there  were  13  documents  listed  as  containing 
the  term  iron  chloride  and  at  least  one  of  the  terms  from  the  list  of  proper¬ 
ties.  By  reversing  the  two  major  groups  of  terms  in  a  second  question,  the 
searcher  was  able  to  correlate  the  individual  properties  with  the  general 
group  of  halides  so  that  in  the  search  tabulation  it  was  shown,  for  example, 
that  18  documents  were  concerned  with  the  physical  properties  of  one  or 
more  halides.  By  manually  correlating  the  two  results,  the  searcher  was 
able  to  tell  the  user  which  documents  dealt  with  the  physical  properties  of 
aluminum  chloride,  which  documents  dealt  with  the  thermodynamic  properties 
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of  iron  chloride,  etc.  Although  either  one  of  the  searches  would  have  ans¬ 
wered  the  question,  by  combining  the  two  searches  it  is  believed  that  the 
user  was  furnished  with  mere  useful  information  that  undoubtedly  saved  him 
valuable  time. 


The  strategies  discussed  above  were  based  on  the  assumed  capabili¬ 
ties  of  the  University's  computer  facilities.  The  system's  complete  data 
bank,  along  with  the  established  programs,  was  transferred  to  the  WPAFB 
computer  facilities  at  the  end  of  this  reporting  period.  It  is  hoped  that  fur¬ 
ther  advancement  in  search  strategies  will  be  possible  on  this  larger  com¬ 
puter.  In  particular,  all  strategies  now  used  are  limited  by  the  term-group 
order.  That  is,  at  least  one  term  in  the  first  group  must  be  present  before 
a  search  is  made  for  a  term  in  this  second  group,  a  term  from  each  of  the 
first  two  groups  must  be  present  before  a  search  is  made  for  a  term  in  the 
third  group,  etc.  It  is  conceivable  that  in  a  search  containing  eight  term- 
groups,  many  documents  may  not  have  been  retrieved  due  to  a  missing  term 
from  one  of  the  first  groups.  It  is  desirable,  therefore,  to  have  a  search 
program  that  is  not  restricted  to  term-group  order  but  that  will  tabulate  the 
documents  according  to  the  number  of  term-group  correlations  such  as  any 
six  out  of  eight,  five  out  of  eight,  etc. ,  and  to  list  the  groups  or  terms  that 
caused  the  correlation.  A  program  of  this  kind  is  now  under  study. 


IV.  SUMMARY 

The  use  of  a  controlled  vocabulary  has  greatly  increased  the  efficiency 
of  the  document  retrieval  system  that  was  established  by  the  University  for 
the  Air  Force  Materials  Laboratory.  The  system  now  contains  about  30,000 
scientific  and  technical  documents  pertaining  to  all  phases  of  materials  re¬ 
search  and  is  controlled  by  a  fairly  stable  vocabulary  of  10,  000  terms.  The 
only  area  in  which  any  difficulty  has  arisen  is  in  the  searching  for  specific 
materials  in  the  field  of  metallurgy;  the  number  of  requests  for  specific  ma¬ 
terials  is  increasing  and  more  time  is  required  to  screen  search  results.  In 
all  other  areas,  the  controlled  vocabulary  has  been  beneficial  to  both  the  in¬ 
dexing  and  the  searching  processes  as  well  as  reducing  the  size  of  the  data 
bank. 


The  overall  system  will  be  complemented  during  the  coming  year  by 
the  use  of  microfilm  equipment.  When  this  system  was  first  established, 
a  decision  was  made  not  to  include  symposia  proceedings  or  handbooks  in 
the  system  until  a  later  date.  As  the  size  of  the  system  increased,  it  be¬ 
came  less  desirable  to  include  those  items  in  the  main  system.  A  method 
of  handling  symposia  proceedings  and  handbooks  is  now  available,  how¬ 
ever,  through  the  Laboratory's  purchase  of  a  Recordak  Miracode  System. 

In  addition,  that  system  will  also  be  able  to  handle  abstracts  of  reports  that 
are  received  from  Foreign  Technology  Division  and  any  other  subsystems 
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that  may  eventually  be  established.  Microfilm  equipment  will  also  be  used 
at  the  University  for  the  indexing  of  documents  that  are  received  only  in 
micro  card  form,  for  screening  search  results,  and  for  furnishing  users 
with  abstracts  of  pertinent  documents  instead  of  merely  access  numbers. 
Since  the  Laboratory  is  not  a  document  distribution  center,  the  bibliographic 
information  that  is  contained  on  the  abstract  sheets  will  be  helpful  in  order¬ 
ing  copies  of  the  documents  from  the  Defense  Document  Center  or  other  dis¬ 
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